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ON  THE  PROBLEM  OF  OPTIMAL  SIGNAL 
DETECTION  IN  DISCRETE-TIME, 
CORRELATED,  NON-GAUSSIAN  NOISE 


INTRODUCTION 

Optimal  signal  detection  in  an  environment  of  non-Gaussian  noise  is  an  important  and  difficult 
problem,  and  solutions  to  it  have  been  obtained  only  under  limited  conditions.  The  need  to  identify 
optimal  detection  structures  is  motivated  theoretically  by  the  observation  that  a  failure  to  recognize 
noise  as  non-Gaussian  can  lead  to  significant  detection  performance  degradation  in  cases  such  as  radar 
signal  detection  scenarios. 

Because  of  the  need  to  identify  optimal  detection  structures,  most  researchers  in  this  area  have 
proceeded  in  one  of  two  ways.  One  approach  has  been  to  assume  that  the  samples  that  make  up  the 
observed  data  vector  are  independent  and  identically  distributed  according  to  a  given  non-Gaussian 
probability  density  function  (pdf)  [1-13].  Since  the  problem  of  specifying  the  optimal  signal  detection 
structure  requires  knowledge  of  the  multivariate  pdf  of  the  noise  vector,  this  problem  may  be,  at  least 
theoretically,  solved  in  its  entirety,  since  the  knowledge  of  the  univariate  pdf  (i.e.,  the  marginal  pdf) 
is  sufficient  to  fully  determine  the  required  multivariate  pdf  for  independent  samples. 

A  second  approach  has  been  to  obtain  the  asymptotically  optimal  detection  structure  [14-25]  for 
a  given  noise  background.  Although  this  problem  is  not  limited  to  the  assumption  of  independence, 
the  resulting  detection  structures  often  require  a  large  number  of  samples  to  achieve  acceptable  detec¬ 
tion  performance.  The  asymptotically  optimal  detection  structure  may  achieve  good  performance  in 
the  small  sample  case  (this  result  holds  in  the  Gaussian  case,  for  instance),  but  this  issue  is  not  easily 
addressed.  In  addition  to  these  two  prevalent  approaches,  a  limited  number  of  results  have  been 
obtained  for  the  more  general  case  of  finite  sample  detection  of  signals  in  non-Gaussian  noise  with 
constraints  imposed  on  the  covariance  structure  of  the  noise  process  [26-28]. 

Recently,  results  have  been  obtained  for  the  more  general  problem  of  detecting  signals  in  non- 
Gaussian  noise  with  a  general  covariance  structure  [29-31],  Those  results  were  obtained  by  assuming 
that  the  univariate  pdf  and  the  covariance  structure  of  the  noise  were  known.  A  multivariate  pdf  with 
marginal  pdfs  equal  to  a  given  univariate  pdf  and  with  the  assumed  covariance  structure  was  con¬ 
structed,  and  the  detection  structure  was  determined  by  applying  the  Ney man- Pearson  criterion  to  the 
resulting  likelihood  ratio.  The  approach  seems  reasonable,  but  it  is  not  without  some  arbitrariness. 
Although  the  Gaussian  random  process  is  completely  specified  by  its  mean  and  covariance  function,  a 
non-Gaussian  process  is  usually  not  completely  specified  by  such  information.  One  may  then  ask  if 
knowledge  of  the  univariate  statistics  and  the  covariance  function  of  a  non-Gaussian  process  is  suffi¬ 
cient  (or  even  reasonable)  for  solving  the  problem  of  optimum  signal  detection  in  this  non-Gaussian 
noise. 

To  examine  this  issue,  we  present  two  general  models  (both  previously  described  in  the  litera¬ 
ture)  for  non-Gaussian  noise  and  show  that  they  may  be  used  to  construct  two  different  non-Gaussian 
multivariate  pdfs  that  have  the  same  marginal  pdf  and  the  same  covariance  structure.  We  restrict  our 
attention  to  the  more  general  problem  of  detection  in  the  presence  of  narrowband  noise,  although  the 
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application  of  our  results  to  the  case  of  strictly  real  random  variables  is  straightforward.  We  show 
that,  in  general,  these  two  models  lead  to  different  optimal  detection  structures.  We  also  present  an 
example,  applicable  to  the  radar  case,  which  shows  that  the  detection  performance  differs  significantly 
for  the  two  models,  even  though  they  are  equivalent  in  the  major  attributes  we  have  indicated. 

NON-GAUSSIAN,  CORRELATED  NOISE  MODELS 

In  this  section  of  the  report,  we  present  two  narrowband  non-Gaussian,  correlated  noise  models. 
These  models  are  constructed  based  on  an  assumed  knowledge  of  a  univariate  amplitude  pdt  and  a 
covariance  structure.  More  specifically,  let  xt  be  a  complex  noise  sample 

.r,  =  |  x,  |  cos  <t>j  +  j  |.r,  \  sin  <j>t  i  =  1 . m.  (1) 

We  a  sume  that  the  pdf  of  |  x,  | ,  h(  |.t,  | ),  is  known,  and  that  the  phase  <£,  is  independent  of  |  xt  \ 
and  i  uniformly  distributed  between  0  and  2ir.  This  assumption  leads  to 

r  h  ( j  Xj  | ) 

fx  =  ~r~\ — r  1  =  1  —  > m .  (2> 

2»k- 


where  fx  is  the  complex  univariate  pdf  of  jc,  . 

Note  that  the  .v,  are  identically  distributed.  We  assume  also  that  a  covariance  matrix  Rx  is  known, 
where 


Rx  =  \E(XjXj) },  i,j  =  1 . m  (3) 

and  the  bar  indicates  complex  conjugate. 

Transformation  Noise  Process 

The  first  model  is  the  so-called  transformation  noise  model  described  for  real  variables  in  Ref. 
24,  and  applied  to  the  narrowband-signal  case  in  Refs.  29  through  31.  For  the  narrowband-signal 
case,  the  model  may  be  formulated  as  follows. 

Specify  a  one-to-one  invertible,  nonlinear  transformation 

I  >'/  I  =  g  ( |  xt  | )  i  =  1 . m  (4a) 

M  i  =  1 . m  (4b) 

such  that  l  y,  j  is  a  Rayleigh  random  variable,  and  |ar,  |  is  a  random  variable  distributed  according  to 
ht  '  x,  )  d.->  ..pec i tied  above.  In  general,  this  nonlinear  mapping  is  given  by 

! y,  I  =  g(  |.r,  I )  =  yf-2oy 2  In  (1  -  H(\Xj  \ )],  /  =  1 . m  (5) 


2 


NRL  REPORT  9177 


where 

o~  is  the  Rayleigh  parameter  (same  for  all  i ), 

H(  )  is  the  Cumulative  distribution  function  associated  with  the  pdf  /t(  ). 

This  mapping  is  then  applied  to  the  samples  xt,  y,  as 

v,  =  C(.x,)  =  g(-  -p  x,  i=l . m  (6a) 

l-TI 

Xj  =  U(v,)  =  r-y-'—.y,-  ‘  =  1 . m  <6b) 

I  }i  \ 

where 

Xi  =  [y,  ...  y„,  ] 7  is  the  vector  of  complex  samples  with  a  zero  mean  multivariate  Gaussian  pdf 
-x,  =  [,x !  . . .  xm]T  is  the  vector  of  complex  samples  with  a  non-Gaussian  multivariate  pdf 
T  stands  for  transpose. 

Note  that  the  mapping  indicated  in  Eqs.  (5),  (6a),  and  (6b)  transforms  only  the  amplitude  of  the  com¬ 
plex  sample  while  leaving  the  phase  unchanged.  As  a  result,  the  vector  x  is  a  complex  vector  with 
complex  marginal  pdfs  given  by  Eq.  (2).  The  multivariate  pdf  of  x  may  be  obtained  by  the  straight¬ 
forward  application  of  the  theory  of  transformation  of  random  variables  and  is  given  by 


'E(x) 


(7) 


where 

t  =[■*!•••  xm]r , 

Vix)  =  \V(xO  ...  V(xm))T, 

R v  is  the  covariance  matrix  of  underlying  complex  Gaussian  random  vector  y, 
J  is  the  Jacobian  matrix  associated  with  the  transformation 
|  |  is  the  matrix  determinant,  and 
r  is  the  complex  conjugate  transpose. 
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As  shown  in  Ref,  29,  the  term  \J  |  is  in  general  equal  to 


s  ( k  I ) 


dg(\Xi\) 


ki  =  n 

i =t 


d\Xj 

k  I 


'  hich  in  this  case  may  easily  be  shown  to  be  equal  to 


.  ,  "  h(\Xj\)ay2 

,V,  ki  10  "  H(\xi  I))  ' 


To  complete  the  discussion  of  the  model,  we  must  examine  the  relationship  between  Ry ,  the 
covariance  matrix  of  y  and  Rx ,  the  covariance  matrix  of  x ,  which  we  have  assumed  is  known.  At 
this  point,  it  suffices  to  say  that  since  the  nonlinear  transformation  given  by  Eqs.  (5),  (6a),  and  (6b)  is 
a  one-to-one  mapping,  the  relationship  between  R.  and  Rx  is  unique.  We  may  therefore  construct  any 
R,  by  the  appropriate  choice  of  Rv.  Further  discussion  of  this  point  is  deferred  to  the  presentation  of 
an  example. 

To  summarize,  a  complex  non-Gaussian  multivariate  pdf, 

1  m  h(  k  I  )a\2  f  1  ,  ] 

/*fc)  '  >>.  exp 


may  be  constructed  with  a  specified  marginal  pdf 


fxM.) 


h(\*i  1) 

2  IT  !  Xj  I 


i  =  1 ,  ■  •  •  ,  m  , 


and  a  specified  covariance  matrix  Rx  that  is  uniquely  determined  by  the  choice  of  Ry. 

Spherically  Invariant  Random  Noise  Process 

A  second  non-Gaussian,  correlated  noise  model  may  be  formulated  based  on  the  class  of  spheri¬ 
cally  invariant  random  processes  described  in  Refs.  32  through  35  and  applied  to  the  radar  sea  clutter 
modeling  problem  in  Ref.  36.  For  the  narrowband  signal  case,  the  model  may  be  applied  as  follows. 

On  any  given  observation,  the  observed  noise  vector  is  a  vector  sample  from  a  Gaussian  distri¬ 
bution  with  a  known  normalized  correlation  matrix  but  with  an  unknown  variance  that  is  the  same  for 
all  the  samples  within  the  observed  vector.  The  unknown  variance  is  then  assumed  to  be  a  random 
variable.  Conditioned  on  this  variance,  <j,2,  the  multivariate  pdf  of  x,  is 


/,  „  (x  K2) 


(27T)m  I  A  I  (<7t2)" 


-x'A~'x 
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where 


v  =  [a,  ...  .v,„]r  is  the  vector  of  complex  samples  with  a  conditional  Gaussian  multivariate  pdf. 


A  is  the  normalized  correlation  matrix  of  a , 


ox ~  is  the  variance  (i.e.,  power  level)  of  x  given  observation 


and  is  a  random  variable  that  fluctuates  from  one  observation  to  the  next. 


The  complex  multivariate  pdf  of  a  is  then  given  by 
/.*(*)  = 


1  »  I 


-(  - r —  exp  )  —  -x' A  'a  l p(o2)d(o2), 

(2ir)m  |  A  |  (ax2)m  I  2at2  f 1  * 


GO) 


where 


p(ox2)  is  the  pdf  of  the  random  variable  ax2. 


To  ensure  that  fx( x)  has  the  assumed  marginal  pdf  given  by  Eq.  (2),  it  is  sufficient  to  choose  p(ax2) 
as  the  solution  to  the  following  integral  equation: 


'(I-*/  I)  =  f0 


«  A, 


exp 


2ur 


p(ox-)J(ox2), 


(11) 


or  equivalently  to  show  that  the  random  variable  |a,  j  (whose  statistics  we  have  assumed  are  known) 
has  the  following  decomposition: 

I  A,  |  =  oxR;  i  =  1 . m,  (12) 


where 

R j  =  the  Rayleigh  random  variable  with  parameter  =  1 

.  f  2 
ax  =  \  ax. 

The  covariance  matrix  of  a,  Rx  ,  may  be  shown  in  a  straightforward  manner  to  be  given  by 

=  V'A,  (13) 
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where 


=  =  E[ax2\ 


and  is  the  mean  value  of  a  ■ 


To  summarize,  a  complex  non-Gaussian  multivariate  pdf. 


/,(-o  = 


1  f  00  1 

L  TTT  exP 


^  A  “  I  v-  I  2\  2\ 


(27T)m  I  A  I  (at2)" 


2ct, 


T  A  'x  kp(o-/)</(<7/). 


mav  be  constructed  with  a  specified  marginal  pdf 


h  ( |  x,  | ) 

/»(*/)  =  -t— j — f  i  =  1,  ....  m, 

'  2ir  X; 


and  a  specified  covariance  matrix  Rx  that  is  uniquely  determined  by  the  choice  of  A. 

At  this  point,  we  have  presented  two  different  multivariate  non-Gaussian  pdfs,  each  with  the 
same  marginal  pdf  and  the  same  specified  covariance  matrix.  The  question  is  if  these  two  different 
noise  models  that  are  equivalent  in  major  attributes,  i.e.,  marginal  pdf  and  covariance  matrix,  lead  to 
similar  detection  structures.  This  question  is  tantamount  to  asking  if  the  specification  of  the  marginal 
pdfs  and  of  the  covariance  structure  of  a  noise  process  is  sufficient  to  solve  the  signal  detection  prob¬ 
lem  in  non-Gaussian  noise. 

OPTIMAL  DETECTION  STRUCTURES 

The  detection  problem  of  interest  is  a  binary  hypothesis  test 

H():  x  =■  n 


where 


H  | :  x  —  s  +  n  , 


h  is  the  non-Gaussian  noise  vector. 


s  is  the  known  signal  vector. 

The  optimality  criterion  applied  here  is  the  Neyman-Pearson  criterion.  The  optimal  detection  struc¬ 
ture  is  therefore  given  by  a  likelihood  ratio  test 


X(x)  = 


H , 

f.M  \H\)  > 

fM\H0)  < 
“o 


(14) 
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where 


fx(x  |  //,)  is  the  pdf  of  the  observed  vector  x  under  H l 
fx(x  |  H0)  is  the  pdf  of  the  observed  vector  x  under  H0 

T  is  the  threshold  chosen  as  a  function  of  V 
For  the  transformation  noise  mode!  we  have 


X/rvU)  - 


i=i 


s"' 

.v)'/?v-'K(x  -  s)  -  V(x)'Rx~'V(x)  ^  T. 

'  H0 


(15) 


where 

Mk  ~  si  1  )pv2 

^  =  k  -  Si  1(1  -  ff(\Xj  -  s,  I  )] 
h(\*i  Ik2 

1^-  |H  -  //(|t,  |)1 

If  Rx  =  <jy2I ,  then  after  some  algebra  we  have 


h  ( |  .t,  -  Sj  | ) 


Xt7v(t)  - 

1  =  1 


k  -  Sj 

h  ( I X;  | ) 


(16) 


which  is  equivalent  to 


XttvU  )  -  ]7 

i  =  i 


f  xt  —  s  (T/  Sj  ) 

/r,  (•*«) 


(17) 


i.e.,  the  independent  sample  detector.  Thus,  when  Rv  =ov~f ,  we  also  have  /?,  ~ax~l. 
For  the  spherically  invariant  noise  model,  we  have 


J, 


1 


\y/(-0  = 


(or)" 


exp 


-  1 


-(x  -  s)1  A  '(.v  -  .v )  \p(ax  r)(Hoy-) 


2ax 


(oxT 


V^x'y'x 


(18) 


exP  5  — TrA  x  \-p(ox~)d(os 
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We  note  immediately  that  the  choice  Rx  =  ng  J  does  not  cause  Eq.  (18)  to  reduce  to  a  form  that  is 

equivalent  to  Eq.  (17).  From  this  observation,  we  deduce  that  the  two  noise  models,  although 
equivalent  in  the  major  attributes  discussed  above,  are  fundamentally  different  in  at  least  one  respect. 
When  the  correlation  between  samples  is  zero,  one  model  yields  independent  samples,  whereas  the 
other  model  does  not. 

However,  this  observation  does  not  necessarily  indicate  that  the  two  models  may  not  be  con¬ 
sidered  equivalent  within  some  detection  performance  criterion.  To  examine  this  issue,  we  must 
further  examine  the  detection  structures.  From  our  assumption  that  s  is  a  completely  known  signal 
vector,  the  detection  structure  for  the  transformation  noise  model  (Eq.  (15))  is  based  on  a  binary 
'xpothesis  test  comprised  of  simple  hypotheses.  The  detection  structure  for  the  spherically  invariant 
•h'jsc  model,  on  the  other  hand,  is  seen  from  Eq.  (18)  to  be  a  Bayesian  implementation  of  a  test 
.i-mprixed  of  composite  hypotheses.  The  implication  is  that  the  test  implemented  in  Eq.  (15)  is  a 
most  powerful  test  for  the  signal  vector  s ,  whereas  the  test  implemented  in  Eq.  (18)  is  not  necessarily 
i  most  powerful  test.  In  fact,  since  the  most  powerful  test  for  the  spherically  invariant  noise  model  is 
the  matched  filter  test  for  Gaussian  noise  when  the  power  level,  at~,  is  known  on  each  detection  deci¬ 
sion.  no  test  is  uniformly  (i.e.,  uniform  over  all  t  ossible  values  of  at2)  most  powerful  for  testing  for 
\  From  these  observations,  we  conclude  that  the  optimal  detection  structures  for  the  two  noise 
models  are  significantly  different. 

To  answer  the  question  about  the  adequacy  of  the  a  priori  knowledge  that  we  have  assumed 
(i.e..  the  univariate  pdf  and  the  covariance  function)  for  formulating  a  signal  detector,  we  must  exam¬ 
ine  the  performance  of  the  detector  that  results  from  a  particular  noise  model  against  the  data  from 
the  other  model  Since  the  aim  of  these  studies  is  to  build  a  practical  signal  detector,  we  present  two 
suboptimal  but  practical  detectors  and  use  them  for  the  performance  comparison. 

SUBOPTIMAL  DETECTION  STRUCTURES 

Since  the  rationale  for  deriving  these  suboptimal  detectors  from  the  optimal  detectors  is  given 
elsewhere  (in  Ref.  29  for  the  transformation  noise  model,  and  in  Ref.  37  for  the  spherically  invariant 
noise  model),  these  detectors  will  be  presented  here  but  not  derived. 

For  the  transformation  noise  model,  the  test  is  given  by 

"i 

V(.s)'Rt  ‘ULoJ  T,  (19) 

Wo 

where 

s  is  the  steering  vector  obtained  from 


s 


Hf  's . 


u  is  the  amplitude 


o  is  the  phase 


8 


NRL  REPORT  9177 


For  the  spherically  invariant  noise  model,  the  test  is  comprised  of  two  parts  and  is  given  by 


(1) 


If 


I  A  —  1  I 

|  s  A  x  I 
s  A  s 


>  T„ 


(20a) 


is  true,  then  a  signal  detection  is  declared.  If  it  is  not  true,  then 


(2)  In 


f  “  1 

- 7 —  exp 

(a2)"1 


2a  2 


x' A  '.r  — 


s' A  'arl2 
s'  A~ls 


\p(a2)d(a2) 


in  :rkr  exP  I  \p^2)d(o  2) 


(°x~) 


2  ar  - 


H  i 

S' 

W0 


(20b) 


is  evaluated. 

Note  that  both  tests  are  independent  of  the  signal  amplitude  a  and  the  signal  initial  phase  <t>, 
which  often  are  unknown.  The  assumption  of  knowledge  about  s ,  which  represents  a  pulse-to-pulse 
phase  shift,  is  justified,  since  a  bank  of  such  detectors,  each  matched  to  a  different  s ,  may  be  imple¬ 
mented. 

EXAMPLE 

The  Weibull  pdf  is  of  significant  interest  in  the  radar  detection  problem,  since  certain  types  of 
radar  clutter  have  been  shown  to  have  amplitude  statistics  that  are  described  by  it.  In  terms  of  our 
earlier  notation,  we  may  write 

h  ( |  Xj  | )  =  |  Xj  |  a  ~ 1  exp  i  -  \  xt  |  a  i  i  -  1 ,  . .  ,  m  ,  (21) 

m  m  j 


where 

a  is  the  skewness  parameter 
b  is  the  median  value  of  |  jc,  | . 

The  range  0.5  <  a  <  2.0  is  the  usual  range  of  interest  in  the  radar  case  [381.  Note  that  the  value 
a  =  2.0  yields  a  Rayleigh  distribution.  By  applying  the  results  given  above,  the  complex  bivariate 
pdf  is  given  in  the  transformation  noise  model  by 


1 

f  a  In  2 

2 

A. 

1  b“  \ 

r  i  ,  i 

i 

Jx(t)  =  2  , 

-exp  \  -d-V(x)'Rx  'V(x)  > 

(22) 

1 

1 

(2tt)2|/?1 

I  l  2  ' 
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where 


Hr)  =  l nr ,)  V(x2)\r, 


V(x, ) 


v2  In  2 

\x,  | 


l,  2. 


We  further  let 
leads  to 


1 

Pv  1 


and  b  =  1 .  Cantrell  [29]  and  Farina  [30]  have  shown  that  this  choice 


R,  =  cr 


1  px 

P,  l 


(23a) 


where 


or  = 


r  a 

2 

a 

v_  j 


a  (ln2) 


2/„ 


(23b) 


P,  = 


7P>n 


+ 1 


i  +  2 

a  a 


Pv‘ 


a 

v. 


1  ,  3  .  1  1  .  2 

- h  -r.  —  +  -r.  2,  pv 

a  2  a  2 


(23c) 


where 

T(  )  is  the  gamma  function  and 
H  ...  )  is  the  Gauss  hypergeometric  function. 

To  show  that  the  Wcibull  amplitude  pdf  may  Fit  into  the  framework  of  the  spherically  invariant 
noise  model,  we  must  show  that  the  Weibull  pdf  satisfies  the  integral  equation  given  in  Eq.  (11)  or 
the  decomposition  given  by  Eq.  (12).  These  properties  are  shown  in  Appendix  A  for  skewness 
parameter  a  =  2.  1  and  1/2.  s.uereas  Kim  [39]  has  given  an  approximate  solution  to  the  integral 
equation  in  Eq.  (11)  that  is  accurate  for  the  range  1  <  a  <  2.  As  shown  in  Appendix  B,  the  com¬ 
plex  bivariate  pdf  for  this  case  is  given  by 

!  o  In  2  |  f  In  2  ,  |  /2  [ 

1  b“  )  |  b“  J 

l,(\)  -  - ; - - - ; — - 

(270- 1  A  j  (r '  A  j:  )“  " 


1  + 


(2  -  a) 


a  In  2 
b“ 


(x'h~\x)' 


- 1  „  a 


(24) 
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In  the  example  above,  we  choose 


1  Px 


r 


a  (In  2)a 


(25a) 


(25b) 


Note  that  we  do  not  actually  choose  pa  -  at  will,  for  it  is  determined  by  p(ox :).  However,  since  the 
Weibull  pdf  may  fit  as  a  spherically  invariant  noise  model  and 

by  definition,  Eq.  (25b)  is  always  true. 

In  the  radar  problem,  it  seems  more  intuitive  to  call  the  spherically  invariant  noise  process  a 
spatial  noise  process,  since  the  variation  in  a  2  is  thought  to  be  induced  by  a  spatial  variation  in  the 
radar  backscatter  process  [40J.  Thus,  from  now  on,  the  spherically  invariant  random  noise  will  be 
referred  to  as  spatial  noise. 

To  proceed  we  assume  that 

s  =  [  1  +  j 0  0  +  yl]r 

and  evaluate  each  of  the  two  suboptimal  noise  detectors  given  above  against  each  of  the  two  noise 
models.  Table  1  shows  the  covariance  information  about  the  noise  used  in  the  examples: 


Table  1  —  Covariance 
Function  for  Example 


a 

7 

( r 

Px 

0.5 

51.985 

0.958 

1.0 

2.081 

0.975 

1.5 

0.970 

0.979 

20 

0.721 

0.98 

For  the  transformation  noise  model,  pv  =  0.98  was  used  for  all  values  of  a  (this  'uhie  of  p,  gen¬ 
erates  the  values  of  pt  given  in  the  table). 

Since  the  computation  of  the  detection  performance  did  not  prove  to  be  tractable  in  closed  form, 
the  performance  was  evaluated  by  Monte  Carlo  simulation.  To  accomplish  this  evaluation,  the  detec¬ 
tor  was  first  applied  against  data  consisting  of  noise  samples  only,  and  the  detection  threshold  that 
yielded  a  desired  probability  of  false  alarm  was  determined  through  the  use  of  the  importance  sam 
pling  technique  [41,42],  This  threshold  was  then  used  in  conjunction  with  the  detector  operated 
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against  data  consisting  of  noise  samples  plus  signal  samples  with  amplitude  a ,  random  initial  phase  4> , 
and  steering  vectoi  s .  The  performance  results  obtained  are  presented  in  Figs.  1  through  4,  where 


=  10  log 


or 
2  <r 


(26) 


The  figures  indicate  the  general  trend  that  the  transformation  noise  detector,  when  operated 
against  the  transformation  noise  model,  yields  uniformly  the  best  detection  performance.  The  perfor¬ 
mance  in  this  particular  case  is  significantly  better  than  the  performance  in  other  cases  at  the  spikiest 
clutter  condition  examined  (the  clutter  is  said  to  get  spikier  asa-  0).  On  the  other  hand,  the  trend  is 
that  at  the  spikier  clutter  conditions,  the  transformation  noise  detector  operated  against  the  spatial 
noise  model  yields  the  worst  performance  of  the  scenarios  tested.  Since  we  have  made  the  two 
models  equivalent  in  the  attributes  that  we  have  assumed  are  known,  we  may  conclude  that  our  earlier 
observations  about  the  difference  in  the  detection  structures  is  supported  by  the  example  we  have 
evaluated.  It  seems  that  knowledge  of  the  univariate  pdf  and  the  covariance  function  of  the  non- 
Gaussian  noise  process  is  not  sufficient  for  the  solution  of  the  signal  detection  problem. 


-  25  -  20  -  15  -10  -  5  0  5  10  15  20 


SIGNAL  TO  CLUTTER  RATIO  (S/C)  PER  PULSE  IdB) 
Fig.  I  Performance,  u  =  2,  p  =  0.98,  Pfu  =  10e-6 


SIGNAL  ro  CLUTTER  RATIO  lS/Cl  PER  PULSE  (dBl 

Fig.  2  —  Performance,  a  =  1.5,  p  =  0.979,  Pfa  =  I0p  7 
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Fig.  3  —  Performance,  a  =  1.  p  =  0.9751.  Pfa  =  lOe 


Fig.  4  —  Performance,  a  =  0.5,  p  =  0.9582,  Pfa  =  lOe  7 


To  give  a  further  point  of  reference  for  the  detection  performance  against  the  spikiest  clutter. 
Fig.  4  is  reproduced  in  Fig.  5  with  the  performance  of  the  matched  filter  detector,  |f'A_1x  | ,  against 
the  two  models  added  for  comparison.  This  comparison  indicates  that  in  the  absence  of  any  addi¬ 
tional  a  priori  knowledge  other  than  that  which  we  have  assumed,  the  matched  filter  detector  is  safer 
than  the  transformation  noise  detector  if  we  seek  to  minimize  the  maximum  risk  that  we  take  in 
implementing  a  detector.  The  spatial  noise  detector  yields  better  performance  than  that  of  matched 
filter  detector,  but  the  increase  in  performance  may  not  be  sufficient  to  warrant  the  added  complexity 
of  implemc  ting  the  spatial  noise  detector.  A  designer  constrained  by  the  complexity  of  implementa¬ 
tion,  unless  the  added  complexity  yields  a  significant  payoff,  may  implement  the  matched  filter  rather 
than  either  of  the  two  detectors  presented  here.  Clearly,  then,  further  research  in  this  area  should 
focus  on  determining  what  a  priori  information  is  sufficient  to  allow  for  an  adequate  formulation  of 
the  detection  problem  that  realizes  the  potential  gain  in  the  detection  performance  that  a  non-Gaussian 
noise  model  offers  relative  to  the  Gaussian  noise  model. 

SUMMARY 

Two  non-Gaussian  noise  models  that  may  be  made  to  have  the  same  univariate  statistics  and  the 
same  covariance  function  are  presented.  The  general  optimal  detection  structure  for  each  of  the  noise 
models  with  a  completely  known  signal  is  given;  the  two  detection  structures  are  shown  to  differ  in 
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Fig.  5  —  Performance,  a  =  0.5.  p  =  0.9582,  Pfa  =  10e  7 


fundamental  ways.  This  difference  indicates  that  a  noise  model  based  on  univariate  statistics  and  a 
covariance  function  is  not  sufficient  to  formulate  the  solution  of  the  signal  detection  problem  in  non- 
Gaussian  noise.  A  radar  example  of  significant  practical  interest  is  presented  to  support  this  general 
conclusion. 
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Appendix  A 

DECOMPOSITION  OF  WEIBULL  RANDOM  VARIABLE  FOR  SELECTED 
VALUES  OF  THE  SKEWNESS  PARAMETER 


The  Weibull  pdf  is  given  by 

/i(<o)  =  ab(ja  ~le~bu>"  to  >  0,  (A- 1 ) 

where 

a  is  the  skewness  parameter 
b  is  the  scale  parameter. 

We  wish  to  show  that  for  the  values  of  the  skewness  parameter,  a  =2,1,  and  1/2  .  the  Weibull  ran¬ 
dom  variable  to  has  the  decomposition 


to  =  a/? 


where 


R  is  the  Rayleigh  random  variable  with  unit  parameter 
a  is  the  random  variable  independent  of  R. 

If  we  let  a  =  2,  we  have 


(A-2) 


h(u:a  =  2)  =  2bwe  bu> ,  (A-3) 

which  is  a  Rayleigh  pdf  with  parameter  1/2 b.  Clearly,  then,  when  a  =  2,  the  random  variable  to 
trivially  satisfies  the  decomposition  given  by  Eq.  (A-2),  i.e.. 


to 


(A-4) 


For  this  value  of  the  skewness  parameter,  the  pdf  of  a2  is 


pia2)  =  6 


a2 


2b 


(A-5) 


I 
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where 

5(  )  is  the  Dirac  delta  function, 
and  the  Weibull  pdf  may  be  written  as 


A(«;a  =  2)  =  (  “  4*  2<^ 


a2 


2b 


d((T). 


If  we  let  a  =  1.  we  have  for  the  Weibull  pdf 


h(oi\a  =  1)  =  be-h“. 


which  is  an  exponential  pdf.  The  exponential  distribution  is  a  special  case  of  the 
whose  pdf  is  given  bv 


/  M 


2v 

- 


J7 _ 

I>) 


>  0, 


where 

F(  )  is  the  7  function, 

Kv  _  |(  )  is  the  modified  Bessel  function  of  the  second  kind  of  order  v  -  1 
v,  t)  are  the  parameters  of  the  distribution. 

Since 


K\/2(z) 


K  )  =  Kfe), 


and 


171/2)  = 


then,  if  we  let  v  =  1/2,  we  have 


r 


1 


(A-6) 

(A-7) 

distribution, 

(A-8) 


(A-9) 
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(A- 10) 


which,  if  we  set  ^  1/r/  =  b ,  is  equivalent  to  our  Weibull  pdf  with  a  =  1.  The  K  pdf  has  the  known 
functional  decomposition 


/(oo)  =  L  2,r  p  {<r)d  (a2) 

Jo  f/ 


where 


pip1)  =  - 

Thus,  with  v  =  1/2  and  17  =  1/62,  we  have 


-(a2)"-1*’  ” 


hiW  =  1)  =  J  3 


r0*  b 


0  ff2 


d(<r). 


(A- 1 1) 


(A-12) 


(A- 13) 


which  corresponds  to  Eq.  (A-2). 

Finally  to  examine  the  case  a  =  1/2,  we  consider  that  any  Weibull  random  variable  may  be 
shown  to  have  the  representation 


w  =  (x)l/a 


(A- 1 4) 


where  x  is  a  random  variable  with  pdf 


p(x)  =  be  bx ,  x  >  0 


(A- 15) 


i.e.,  exponential.  We  have  shown  that  the  exponential  random  variable  has  the  representation 

x  =  'JyR,  ( A- 16) 


where  7  is  a  random  variable  with  pdf 


b: 

b 

pit)  =  rr  e 


(A-17) 


^liry 

Substituting  of  Eq.  (A-16)  into  Eq.  (A- 14)  shows  that  any  Weibull  random  variable  has  the  represen¬ 
tation 


co  =  i'iyR) 


I/O 


(A- 1 8) 


Let  t  =  R^/n  and  examine  the  pdf  of  t.  This  pdf  is  easily  shown  to  be 
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««>  =  y 


(A- 1 9) 


which  shows  that  t  is  a  Weibull  random  variable  with  skewness  parameter  2 a  and  scale  parameter 
1/2.  But  we  have  already  shown  in  Eq.  (A-18)  that  t  may  be  represented  as 


where  the  pdf  of  (3  is 


r 

1 


1/2  a 


(A-20) 


P(&) 


-(3/8 


V2iri3 


(A-21) 


(i.e..  in  Eq.  (A-18),  let  w  —  t ,  a  —2  a,  7  —  (3  and  in  Eq.  (A- 1 7)  let  b  —  1/2  ).  Back  substitution 
in  Eq.  (A-18)  shows  that  a  general  Weibull  random  variable  of  skewness  a  and  scale  b  may  be 
represented  as 


CJ  =  (^y)'/a  (^R)U2a . 


(A-22) 


At  this  point  we  could  continue  this  process  further,  since  we  again  have  a  random  variable  of  the 
form  Rr ,  where  p  is  a  constant,  and  we  have  shown  that  this  random  variable  is  a  Weibull  random 
variable.  For  our  interest,  though,  we  may  stop  with  Eq.  (A-22)  and  examine  it  when  a  =1/2,  i.e., 


=  y^R , 

which  is  the  decomposition  we  are  seeking  to  show.  For  a  =  1/2,  we  therefore  have 

=  1/2)  =  |  -^re~u'/2crp(a2)d(<r\ 

0  n 


(A-23) 


where 


a2  =  72/3. 


(A-24) 


(A-25) 


A  straightforward  application  of  the  laws  of  transformation  of  random  variables  with  Eqs.  ( A  - 1 7 )  and 
(A-2 1 )  yields 


b  r  "  1  I  <r 

p(<r)  =  - — j()  —7=-  exp 


b 


Airier 


7V7 


87“ 


*d  7. 


(A-26) 


Further  evaluation  of  this  integral  does  not  appear  to  be  tractable. 
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Appendix  B 

MULTIVARIATE  PDF  FOR  SPHERICALLY 
INVARIANT  NOISE 


Although  more  than  one  approach  is  available  to  derive  the  desired  pdf.  a  very  straightforward 
approach  is  as  follows. 


The  multivariate  pdf  is  given  by 

1 


/,(*>  = 


(2ir)m  |  A  | 


(  — ; —  exp 

(<V)m 


2a, 


—x' A  xx  t p(ox2)d(ox2),  (B-l) 


where  p(ax~)  satisfies 


h  (  | Xj  !  )  = 


,  00  I  x,  I 
!„  — 


2a/ 


p(ax2)d(a/)< 


and  h  (  !  .r,  | )  is  known.  Define  z  =  1  /ac 2.  Substitution  in  Eqs.  (B-l)  and  (B-2)  yields 


f'(x)  =  (z.rlAi'  exP  i  \f{z)dz- 


(B-2) 


(B-3) 


T 


It  I )  =  J0  It  I  exp  j - — z  r zf(z)dz 


(B-4) 


Now  define 


q(z)  =  zf(z). 


With  this  definition,  Eq.  (B-4)  becomes 

h(\x,\) 


r  J  ITT  1  , 

J0  qiz)  exp  1 —  z  rdz 


(B-5) 


(B-6) 


If  we  let  v  =  | x,  |  / 2  and  Q (v )  be  the  one-sided  Laplace  Transform  of  q(z)  ,  we  then  have 

hp-2s  ) 


Q(s)  = 


V2.s  * 


(B-7) 
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and 


<7(z)  = 


1 

2  Try 


c+j°° 

f  Q(s)eszds, 

J  i - I  oo 


(B-8) 


where  c  is  greater  than  the  real  part  of  any  singularities  of  Q . 


We  now  use  the  result  in  Eqs.  (B-5)  and  (B-8)  in  Eq.  (B-3)  to  obtain 


/,(■*> 


1  1 
2 Try  (2x)m  |  A 


<■  ~j °°  v  2$ 


OO 


„  m  -  1 
<- 


exp 


-r'A 


-i, 


C  +C5  f  rfer/s.  (B-9) 


Since  r'A  *.v  is  positive  definite,  if  we  assume  m  >  1  (a  trivial  assumption)  the  integral  over  c  con¬ 
verges,  and  we  have 


-l)m  (m  -  1)! 

f  ('+t°°  h(^2s  ) 

1 

2 Try  Qir)m  |  A  | 

8 

1 

r  r~ i 

s  —  — x  A  x 

2 

L  j 

m 

If  we  now  assume  that  s 


+  yu>  and 


lim 

O  —  OC 


h  ('ll s  ) 
^ 2s 


0, 


(B-10) 


and  that  h('2s  )/'■! s  is  analytic  in  the  right-half  plane,  then  by  complex  analysis  we  have 

,  (-l)"-'  dm~] 

Jx  X  (2ir)m  |  A  |  dsm~'  \  ^2s  js=±x’A'x' 


(B-l  1) 


If  m  =  2  and  h(  )  is  the  Weibull  pdf,  the  various  assumptions  that  were  made  hold,  and  we  get  Eq. 
(24)  of  the  main  body  of  the  report.  Less  straightforward  approaches  that  do  not  use  complex 
analysis  yield  the  same  result. 
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